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Graphical  Interfaces  for  Simulation 


JAMES  D.  HOLLAN,  EDWIN  L.  HUTCHINS,  TIMOTHY  P.  McCANDLESS, 

MARK  ROSENSTEIN,  and  LOUIS  WEITZMAN 


INTRODUCTION 

In  order  to  illustrate  the  type  of  graphical  interface  with  which  we  are  concerned,  we  begin  by  briefly 
describing  Steamer,  a  system  which  employs  an  interactive  graphical  interface  to  a  steam  propulsion 
plant  simulation.  Steamer  is  a  research  project  involved  with  evaluating  the  potential  training  applica¬ 
tions  of  techniques  from  the  new  disciplines  of  artificial  intelligence  and  cognitive  science.  While  the 
project  addresses  a  host  of  research  issues  ranging  from  how  people  understand  complex  dynamic  sys¬ 
tems  to  how  AI  software  and  hardware  advances  might  be  applied  to  training,  it  is  focused  around  the 
construction  of  a  computer-based  system  to  assist  in  propulsion  engineering  instruction.  The  goal  of  the 
project  is  not  only  to  build  a  training  system  with  tutorial  and  explanation  facilities  but  also  to  construct 
a  set  of  software  tools  to  assist  in  the  implementation  of  simulation-based  training  systems  and  graphi¬ 
cal  interfaces. 

Steamer  currently  consists  of  a  graphical  interface  to  a  mathematical  model  of  a  steam  propulsion 
plant  The  interface  allows  a  user  to  select  from  a  library  of  propulsion  plant  views  and  interact  with  a 
selected  view  to  change  the  state  of  the  underlying  simulation  model.  The  evolution  of  plant  states  can 
be  observed  by  graphical  changes  in  the  view  on  a  color  display.  Views  depict  aspects  of  the  propul¬ 
sion  system  at  various  levels  of  detail.  They  vary  from  collections  of  gauges  and  indicators  typically 
found  in  a  real  plant  to  schematic  diagrams  specifically  designed  to  depict  models  similar  to  those 
experts  seem  to  employ  in  reasoning  about  the  operation  of  the  propulsion  plant.  The  potential  for 
increased  instructional  effectiveness  derives  from  representations  with  the  ability  to  show  global  views 
of  systems  that  are  physically  dispersed  in  the  actual  plant  and  thus  difficult  to  see  as  a  total  system,  to 
show  simplified  versions  of  systems  designed  to  be  easier  to  understand  or  to  provide  better  models  for 
reasoning  about  the  plant,  to  look  "inside"  systems  or  components  and  see  flows  or  other  internal 
characteristics,  and  to  make  available  indicators  that  depict  aspects  of  the  operation  of  a  system  not  nor¬ 
mally  available  but  that  are  useful  in  developing  an  understanding  of  a  system. 

Figures  1  through  4  are  black  and  white  renditions  of  views  a  user  of  Steamer  would  see  on  a  color 
graphics  screen.  State  information  is  depicted  by  color,  by  animation,  and  by  analog,  digital,  and  tex¬ 
tual  changes.  For  example,  operational  status  of  a  pump  or  valve  is  indicated  by  color  (red  for  off; 
green  for  on);  flow  rates  in  pipes  are  dynamically  shown  by  use  of  animation  techniques;  dials  and 
graphs  reflect  plant  parameters.  The  iconic  representation  serves  both  to  provide  state  information  and 
as  a  mechanism  for  changing  state  of  an  underlying  simulation.  By  pointing  to  a  component  with  a 
mouse-controlled  cursor,  a  user  can  change  its  state  by  clicking  on  it.  For  example,  clicking  on  a  pump 
will  toggle  its  state.  Similarly  one  can  vary  the  level  of  a  tank,  change  the  value  of  a  dial,  or  position  a 
throttle.  Of  course,  the  nature  of  the  underlying  simulation  and  the  goals  of  the  interface  designer 
determine  which  variables  and  thus  which  components  can  be  manipulated  by  a  user.  The  important 
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point  here  is  that  the  interface  functions  as  a  two-way  communication  device:  depicting  and  allowing 
changes  of  state. 

A  high-level  view  of  the  Main  Engine  Lube  Oil  System  is  depicted  in  Figure  1.  One  can  watch  the 
state  of  the  lube  oil  system  and  its  responses  to  changes  made  to  the  propulsion  system.  The  flows  in 
the  system  are  dynamically  depicted  by  animation  within  pipes;  the  connectivity  of  the  system  is 
shown.  The  states  of  the  lube  oil  service  pumps  (LOSP1A-C)  are  indicated  by  color  changes.  In  Fig¬ 
ure  1  the  attached  pump  LOSP1C  is  operating,  LOSP1B  is  off,  and  LOSP1A  is  operating  at  low  speed 
(colors  in  the  figure  are  represented  by  differing  gray  shades).  A  series  of  pressure  sensors  is  shown  at 
the  lower  right  of  the  view,  along  with  digital  and  analog  representations  of  lube  oil  pressure.  These 
sensors  monitor  pressure  at  the  bearing  most  distant  from  the  pumps  and  will  automatically  control  the 
state  of  the  service  pumps  if  pressure  drops  below  specified  levels.  The  valve  at  the  top  left  is  the  lube 
oil  unloader  valve  and  the  column  above  it  indicates  how  far  it  is  open.  As  pressure  in  the  system  rises 
above  a  set  threshold,  the  unloader  valve  opens  and  unloads  lube  oil  back  into  the  sump,  preventing 


FIGURE  1.  Main  Engine  Lube  Oil.  The  lube  oil  system  is  distributed  throughout  the  propulsion  plant.  This  view  provides  a  glo¬ 
bal  view  of  its  operation.  Like  most  figures  in  this  chapter,  it  is  a  black  and  while  rendition  of  a  view  normally  presented  on  a 
color  screen.  Dithering  techniques  have  been  used  to  map  from  colors  to  stipple  pattens.  The  boxes  shown  within  pipes  are  used 
on  the  color  screen  to  provide  animation  of  flows. 
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FIGURE  2.  Throttle  Board.  This  view  shows  the  following  major  system  parameters:  superheater  outlet  pressure,  main  steam 
drum  pressure,  train  condensate  vacuum,  astern  pressure,  exhaust  trunk  temperature,  high  pressure  first  stage  turbine  pressure, 
main  lube  oil  pressure,  and  allows  for  control  and  monitoring  of  the  ahead  and  astern  throttles. 


overpressurization.  There  are  two  controller  boxes  and  a  switch  next  to  lube  oil  service  pumps  1A  and 
IB.  By  touching  the  switch  the  system  can  be  put  in  manual  mode,  and  the  controller  boxes  for  the 
pumps  can  be  touched  and  operated  to  change  pump  speed  to  high  (H),  low  (L),  or  stop  (S).  As  the 
controller  is  operated,  the  associated  pump  will  change  state  and  the  ramifications  of  that  change  will 
be  continuously  reflected  in  other  portions  of  the  view. 

Figure  2  shows  a  Throttle  Board  view  that  allows  the  user  to  control  the  Ahead  and  Astern  throttle 
and  monitor  a  number  of  important  system  parameters.  Figures  3  and  4  depict  portions  of  the  Feed 
System.  Figure  3  shows  the  states  of  the  two  boilers  (1A  and  IB),  the  level  of  the  deaerating  feed  tank 
(DFT,  a  water  storage  tank),  the  states  of  the  six  pumps  involved  in  the  system,  and  the  large  number 
of  valves  used  to  control  and  direct  the  feed  water  to  the  boilers,  as  well  as  key  system  parameters. 

The  same  type  of  graphical  interface  can  be  provided  for  a  real-time  simulation.  For  example,  Fig¬ 
ure  3  contains  a  view  we  designed  to  monitor  the  dynamic  state  of  one  of  the  computers  on  our  local 
area  network.  It  shows  the  number  of  users  running  various  programs  and  continuously  graphs  inter¬ 
rupts,  system  calls,  cpu  idle  time,  characters  in  and  out,  users  on  the  system,  and  processes  waiting  to 
be  run. 
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MAIN  FEED  SYSTEM 


FIGURE  3.  Main  Feed  System.  Shows  ihe  topology  and  major  components  of  the  feedwater  system. 

These  examples  are  intended  to  illustrate  the  type  of  interactive  graphical  interfaces  with  which  we 
are  concerned.  The  key  notion  is  that  the  interface  serves  as  a  communication  device  to  allow  a  user  to 
see  and  manipulate  the  state  of  an  underlying  simulation  or  real-time  system.  In  the  Steamer  applica¬ 
tion  we  have  been  concerned  with  using  this  form  of  interface  in  training.  It  should  be  clear  that  it  is 
just  as  applicable  for  monitoring  or  controlling  a  system.  Our  primary  concerns  here  are  to  discuss  why 
we  think  this  form  of  interactive  graphical  interface  is  powerful  and  describe  a  set  of  tools  we  have 
implemented  to  facilitate  interface  implementation. 


UNDERLYING  PRESUPPOSITIONS 

A  common  way  of  describing  the  class  of  interfaces  discussed  above  is  as  direct  manipulation  inter¬ 
faces  (Shneiderman,  1982).  In  our  view,  most  of  the  treatments  of  direct  manipulation  interfaces  focus 
at  the  wrong  level  of  analysis.  The  naive  notion  seems  to  be  that  the  key  properties  are  bit-mapped 
displays  and  pointing  devices.  One  of  our  presuppositions  is  that  interfaces  are  representational  systems 
designed  for  communication,  and  just  as  in  the  analysis  of  any  other  representational  system,  it  is 
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MAKE-UP  &  EXCESS  FEED 


FIGURE  4.  Make-up  and  Excess  Feed.  This  is  another  portion  of  the  feed  system  designed  to  show  control  relationships  between 
tank  levels  and  states  of  associated  valves  and  pumps. 


essential  to  understand  the  cognitive  task  that  the  system  is  attempting  to  support.  It  is  an  egregious 
error  to  suppose  that  one  can  discuss  interface  design  outside  of  the  cognitive  contexts  of  the  task 
domain  in  which  an  interface  is  embedded.  The  directness  associated  with  an  interface  comes  from 
how  directly  the  interface  supports  the  user’s  cognitive  task.  Graphical  displays  and  pointing  devices 
are  media  of  support  but  do  not  in  themselves  guarantee  any  directness.  Directness  results  when  the 
interface  language  closely  matches  the  way  in  which  a  user  thinks  of  a  task.  Directness  is  thus  not  a 
property  of  interfaces  but  involves  the  relationship  between  the  task  a  user  has  in  mind  and  the  way  in 
which  the  task  can  be  accomplished  via  the  interface. 

An  interface  provides  a  language  for  the  user  to  communicate  with  a  system  and  for  the  system  to 
communicate  with  a  user.  A  key  notion  for  us  is  the  relationship  between  the  meaning  of  an  expression 
in  the  interface  language  and  what  the  user  wants  to  say.  We  have  termed  this  relationship  Semantic 
Distance  (Hutchins,  Hollan,  &  Norman,  1986).  The  extent  that  an  interface  language  allows  one  to  say 
what  one  wants  to  say  without  circumlocutions  is  the  measure  of  its  semantic  directness.  Another 
aspect  of  directness  is  the  relationship  between  the  meanings  of  expressions  in  the  interface  language 
and  their  physical  forms.  We  call  this  Articulatory  Distance  (Hutchins,  Hollan,  &  Norman,  1986). 
Nonarbitrary  relationships  between  meaning  and  the  way  it  is  physically  expressed  provide  this  form  of 
directness.  A  nonarbitrary  graphical  relationship  between  icons  and  what  they  depict  is  an  example  of 
articulatory  directness.  Similarly,  on  the  input  side  of  an  interface  language,  interfaces  that  allow  one 
to  make  statements  about  position  by  pointing  provide  examples  of  articulatory  directness. 
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FIGURE  5.  Unix  Display.  A  view  designed  primarily  to  illustrate  the  connection  of  a  graphical  view  to  a  real-time  system.  It 
provides  a  summary  of  the  slate  of  an  operating  system  running  on  one  of  the  computers  on  our  local  area  network. 

Thus,  one  of  the  important  underlying  presuppositions  of  our  approach  is  to  view  an  interface  as  a 
representational  language  and  to  place  primary  importance  on  the  cognitive  task  that  a  user  is  attempt¬ 
ing  to  accomplish.  Another  fundamental  presupposition  of  our  approach  is  the  view  that  graphical 
forms  of  representation  provide  powerful  ways  of  bringing  abstract  things  into  the  realm  of  the  percep¬ 
tually  knowable.  We  think  there  are  important  cognitive  properties  that  make  graphical  representations 
effective.  These  properties  derive  from  the  types  of  processing  activities  people  are  especially  good  at: 
detecting  patterns,  constructing  mental  models  or  simulations  of  the  world  which  support  causal  reason¬ 
ing,  and  manipulating  the  world  by  actions  on  it  or  on  representations  of  it 
Rumelhart,  Smolensky,  McClelland,  and  Hinton  (1986)  have  argued  that  one  of  the  effective 
problem-solving  strategies  people  employ  involves  the  creation  of  artifacts,  physical  representations  that 
can  be  manipulated  to  get  answers  to  questions.  They  suggest  that  the  underlying  strategy  is  to  make 
"problems  conform  to  problems  we  are  good  at  solving"  and  argue  that: 

We  are  especially  good  at  pattern  matching.  We  seem  to  be  able  to  quickly  "settle"  on  an 
interpretation  of  an  input  pattern.  This  is  an  ability  central  to  perceiving,  remembering,  and 
comprehending.  Our  ability  to  pattern  match  is  probably  not  something  which  sets  humans 
apart  from  other  animals,  but  is  probably  the  essential  component  to  most  cognitive 
behavior. 

We  are  good  at  modeling  our  world.  That  is,  we  are  good  at  anticipating  the  new  state  of 
affairs  resulting  from  our  actions  or  from  an  event  that  we  might  observe.  This  ability  to 
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build  up  expectations  by  "internalizing"  our  experiences  is  probably  crucial  to  the  survival 
of  all  organisms  in  which  learning  plays  a  key  role. 

We  are  good  at  manipulating  our  environment  This  is  another  version  of  man-the-tool- 
user,  and  we  believe  that  this  is  perhaps  the  crucial  skill  which  allows  us  to  think  logically, 
do  mathematics  and  science,  and  in  general  to  build  culture.  Especially  important  here  is 
our  ability  to  manipulate  the  environment  so  that  it  comes  to  represent  something.  This  is 
what  sets  human  intellectual  accomplishments  apart  from  other  animals.  (Rumelhart  et  al., 

1986,  pp.  44-45) 

If  these  are  indeed  the  types  of  activities  that  people  are  especially  good  at,  there  are  clear  implica¬ 
tions  for  why  graphical  interfaces  may  have  important  cognitive  properties.  They  provide  a  physical 
representational  system  that  permits  us  to  make  abstractions  perceptually  available  and  thus  allow  the 
use  of  our  powerful  pattern-matching  abilities.  They  make  possible  the  depiction  of  models  of  the 
world  that  are  similar  to  the  mental  models  or  simulations  people  seem  to  use  to  reason  about  the 
world.  These  models  can  depict  physical  state  information,  causal  connections,  and  are  runnable,  per¬ 
mitting  a  user  to  see  the  effects  that  result  from  changes  of  state.  Finally,  graphical  interfaces  provide 
the  potential  of  directly  manipulate  representations  of  systems.  These  factors  comprise  another  set  of 
presuppositions  underlying  our  approach  to  graphical  interface  design  and  also  provide  motivation  for 
our  interest  in  simulation-based  systems. 


TOOLS  FOR  CONSTRUCTING  GRAPHICAL  INTERFACES 

There  is  a  need  for  software  tools  to  assist  in  the  creation  of  graphical  interfaces.  Here  we  describe 
a  set  of  tools  we  have  been  evolving  to  facilitate  interface  design.  First  we  describe  a  general  simula¬ 
tion  environment,  which  consists  of  a  Model  Conti  oiler  and  a  Graphics  Editor.  This  is  the  core  of  the 
system  we  are  developing.  It  permits  one  to  build  interactive  graphical  interfaces  to  simulation  models 
or  real-time  systems.  The  Graphics  Editor  makes  available  a  set  of  icons,  facilities  for  modifying 
characteristics  of  icons  (e.g.,  size,  shape,  color,  and  placement),  and  the  ability  to  associate  icons  with 
model  variables  so  that  the  icons  reflect  the  values  of  the  variables  and  so  that  one  can  interact  with  the 
icons  to  change  the  values  of  their  associated  variables.  The  Model  Controller  allows  one  to  run  simu¬ 
lation  models,  observe  the  model’s  state  via  graphical  views  constructed  with  the  Graphics  Editor,  and 
interact  with  the  views  to  change  the  state  of  a  simulation  model. 

We  also  will  describe  a  number  of  related  tools  we  are  developing  to  support  the  construction  of 
interfaces.  Chief  among  them  is  an  Icon  Editor,  which  makes  possible  the  construction  of  new  icons 
without  requiring  a  user  to  operate  at  the  level  of  code  writing.  In  addition  we  discuss  a  series  of 
Knowledge-Base  Editors  for  the  specification  of  domain  knowledge.  We  have  implemented  a  Behavior 
Editor  to  explore  the  incorporation  of  simulation  knowledge  into  icons  and  are  in  the  process  of 
developing  a  Lesson  Editor  to  explore  the  incorporation  of  domain  knowledge  into  graphical  views  so 
that  they  can  explain  themselves,  pose  problems  to  students,  and  monitor  their  answers.  Designer,  an 
interactive  visual  design  consultant  for  users  of  the  Graphics  Editor,  makes  available  graphical  design 
knowledge  during  the  process  of  constructing  and  critiquing  graphical  views.  Underlying  a  number  of 
these  knowledge-base  editors  is  a  frame-based  representational  language.  We  will  also  briefly  describe 
it  and  a  graphical  interface  to  it 


Simulation  Environment 

The  Simulation  Environment  we  have  designed  consists  of  a  set  of  activities  to  allow  users  to  build, 
observe,  and  manipulate  views  of  a  simulation  model  or  real-time  process.  In  our  work  we  have  used 
this  facility  to  build  interfaces  to  mathematical  simulations  such  as  the  steam  propulsion  simulation 
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used  in  Steamer,  real-time  systems,  and  Parallel  Distributed  Processing  (PDP)  models  learning  to  recog¬ 
nize  patterns  in  the  operation  of  underlying  systems.  A  system  consists  of  a  process  and  a  set  of  user 
defined  views  connected  to  that  process. 

One  interacts  with  a  simulation  system  via  its  associated  views.  A  view  is  a  graphical  collection  of 
icons  representing  a  portion  of  a  simulation.  We  have  designed  a  Model  Controller  to  allow  users  to 
manipulate  views,  observe  the  effects  of  the  manipulations,  and  control  the  underlying  simulation 
model.  Using  this  controller,  a  user  selects  two  views.  One  is  typically  a  view  used  to  control  global 
aspects  of  a  system,  while  the  other  is  used  to  manipulate  and  observe  subsystems.  In  Steamer,  for 
example,  the  global  view  contains  the  throttles  for  the  ship  and  important  status  information  and  the 
other  view  can  be  alternated  between  any  of  the  approximately  one  hundred  views  available. 

Each  simulation  environment  activity,  such  as  editing  or  running  a  simulation  model,  is  supported  by 
a  screen  configuration  which  provides  a  set  of  functions  and  menus  to  help  a  user  accomplish  the  tasks 
associated  with  the  activity.  Integrated  into  the  current  simulation  environment  are  the  Model  Control 
and  Graphics  Editor  activities  as  well  as  a  related  set  of  activities  discussed  below. 

Model  Control 

The  Model  Control  activity  provides  facilities  for  changing  systems,  models,  and  views.  It  also 
allows  modification  of  the  behavior  of  a  model,  such  as  the  rate  it  runs  in  the  case  of  a  simulation,  or 
the  rate  an  interface  is  sampled  in  the  case  of  a  real-time  system.  Figure  6  shows  a  typical  configura¬ 
tion  for  the  Model  Controller.  The  status  line  near  the  bottom  of  the  screen  maintains  current  state 


FIGURE  6.  Model  Controller.  The  screen  configuration  of  the  black  and  white  display  dunng  operation  of  a  simulation.  It  pro¬ 
vides  functions  for  controlling  the  running  of  a  simulation,  switching  between  graphical  views,  and  selecUng  other  activities.  Typi¬ 
cally  used  while  viewing  and  interacting  with  a  view  on  the  color  screen. 
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information.  In  this  case  the  Steamer  system  has  been  selected  and  its  associated  model  is  running  with 
the  Make  Up  and  Excess  Feed  view  displayed  on  the  color  screen.  The  right  half  of  the  middle  section 
of  the  screen  shows  a  Steamer  control  view.  At  the  bottom  of  that  view  is  the  ahead  throttle,  and 
immediately  above  that  are  important  data,  such  as  the  ship’s  speed,  engine  rpm,  and  the  fact  that  the 
ship  is  currently  operating  with  one  boiler.  Above  this  information  are  other  indicators  of  the  global 
state  of  the  propulsion  system.  Across  the  top  of  the  screen  are  menus  of  operations  available  for  con¬ 
trolling  the  model  and  views.  The  right  most  menu  choice  allows  changing  activities. 

The  status  line  allows  a  standard  interface  to  a  set  of  general  control  functions.  The  way  to  view  the 
status  line  is  as  a  display  of  attribute  value  pairs  that  describe  the  system  at  a  given  time.  The  attri¬ 
butes  explicitly  displayed  are  the  current  system,  model,  subsystem,  and  view.  An  asterisk  is  used 
to  indicate  a  value  that  has  been  modified.  Whether  a  model  is  running  or  not  is  shown  in  square 
brackets. 


Graphics  Editor 

The  Graphics  Editor  originated  from  our  work  on  Steamer  (Hollan,  Hutchins,  &  Weitzman,  1984) 
and  the  requirement  to  implement  a  large  number  of  dynamic  views  of  a  propulsion  system.  We 
needed  a  tool  which  would  allow  instructors,  who  were  knowledgeable  about  a  domain  but  computer 
naive,  to  create  graphical  interfaces.  The  resulting  Graphics  Editor  has  been  used  to  create  more  than  a 
hundred  views  for  Steamer  and  has  been  designed  to  allow  its  easy  extension  into  other  domains.  The 
editor  provides  a  user  with  a  set  of  icons  that  can  be  arrayed  on  a  graphics  screen  to  create  a  view  of 
an  underlying  simulation  or  real-time  system.  It  provides  functions  commonly  available  in  computer- 
aided  design  systems.  One  can  save  and  restore  views  from  files,  mark  the  elements  of  a  view  (indivi¬ 
dually,  by  type,  within  an  area,  etc.),  and  edit  those  marked  elements  (moving,  copying,  deleting, 
changing  color,  size,  etc.).  A  grid  facility  is  provided  to  assist  in  accurately  positioning  icons  within  a 
view. 

The  multipaned  menu  interface  to  the  editor  activity  is  shown  in  Figure  7.  The  status  line  in  the 
lower  portion  of  the  screen  provides  control  facilities  similar  to  those  in  the  Model  Control  activity.  In 
constructing  a  view,  a  user  chooses  icons  from  the  menu  of  icons  and  positions  them  on  the  color 
screen.  Figure  8  depicts  a  subset  of  the  available  icons.  Typically  a  process  of  incremental  refinement 
of  the  view  takes  place  in  which  icons  are  moved  around,  reshaped,  colored,  and  given  labels  and 
appropriate  units. 

An  important  characteristic  of  the  Graphics  Editor  is  the  way  in  which  it  supports  the  association  of 
icons  to  underlying  variables  in  a  mathematical  model  or  real-time  system.  We  call  this  process  tap¬ 
ping.  There  are  two  types  of  taps.  A  probe  tap  associates  a  variable  with  an  icon  so  that  the  icon 
reflects  the  current  state  of  that  variable.  A  set  tap  also  associates  a  variable  with  an  icon  but  in  a  way 
that  allows  one  to  change  the  value  of  the  variable  by  interacting  with  the  icon.  Figure  9  illustrates  the 
tapping  mechanism  and  a  simple  math  model.  On  the  left  are  the  variables  in  a  simple  math  model  and 
on  the  right  are  the  icons  to  which  they  have  been  tapped.  The  toggle  switch  turns  this  model  on  and 
off.  Each  tick  of  the  clock  indicates  that  one  unit  of  time  has  passed  in  the  simulation.  While  the 
model  is  running,  the  valve  sets  its  variable.  This  means  that  when  one  interacts  with  the  column 
above  the  valve,  it  sets  the  value  of  its  variable,  %-VALVE-OPEN,  to  reflect  the  valve’s  degree  of 
openness.  The  pipe,  on  the  other  hand,  probes  its  value,  PIPE-SPEED.  This  means  that  on  each  tick  of 
the  clock,  the  pipe  reflects  the  value  of  PIPE-SPEED  by  changes  in  flow  rate.  When  one  interacts  to 
change  the  state  of  the  valve,  the  effect  propagates  via  the  math  model  and  affects  pipe  flow.  Also 
included  in  the  simulation  are  the  clock  and  toggle  switch  themselves.  The  clock  probes  its  value, 
CLOCK-STATE,  while  the  toggle  switch  sets  its  value,  MODEL-RUNNING. 

To  set  up  the  tappings  of  the  pipe,  a  user  of  the  graphics  editor  would  mark  the  pipe  icon,  then  click 
on  Tap.  This  generates  a  pop-up  menu  (shown  in  Figure  10)  for  specifying  the  tapping  parameters. 
Here  the  tap  probe  has  been  associated  with  the  variable  PIPE-SPEED.  This  will  cause  the  pipe  to 
probe  that  variable  when  run.  Similarly,  values  of  other  tapping  parameters  are  provided.  The  variable 
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%- VALVE-OPEN  would  be  entered  as  the  tap  set  for  the  column  associated  with  the  valve  so  that  it 
would  be  set  in  the  model  when  a  ucer  interacted  with  it  Notice  the  tap  mapping  line  for  the  toggle 
switch  in  Figure  11.  The  mapping  mechanism  allows  the  designer  to  map  the  icon’s  value  from  one 
scale  to  another.  Selecting  logical  would  map  the  "on”  state  to  true  and  the  "off  state  to  nil.  Another 
choice  is  binary,  which  maps  the  "on"  state  to  1  and  the  "off  state  to  0.  All  icons  that  depict  a  state  or 
change  a  state  of  a  math  model  variable  are  tapped  in  this  manner. 

An  associated  facility  to  aid  the  upping  process  is  the  model  augment  There  are  occasions  when  a 
math  model  insufficiently  represents  aspects  of  a  simulation  that  a  designer  might  wish  to  display.  An 
augment  allows  one  to  enhance  the  simulation  model  where  it  is  inadequate,  to  conveniently  write  more 
complex  upping  code,  and  to  provide  stand-alone  simulations  for  views.  For  example,  the  Steamer 
math  model  does  not  represent  flow  in  pipes.  Since  we  think  that  flow  is  important  in  understanding 
causality  in  a  steam  system,  we  often  add  a  model  augment  to  a  view  so  the  iconic  represenutions  of 
pipes  depict  flow  rates.  A  model  augment  also  allows  the  builder  to  derive  values  from  existing  vari¬ 
ables.  In  the  simple  model  augment  shown  in  Figure  9  for  the  pipe  ind  valve  system,  we  wanted  to 
relate  pipe  flow  to  the  sute  of  the  valve:  the  more  open  the  valve,  the  more  flow.  The  model  sets  the 
pipe  speed  to  be  the  openness  of  the  valve  divided  by  100. 

In  designing  and  implementing  the  editor  we  have  capitalized  on  the  flexible  object-oriented  Flavors 
System  of  Zetalisp.  What  is  created  as  a  result  of  the  view  construction  process  is  a  Lisp  program  that 
contains  a  number  of  dynamic  entities  capable  of  responding  to  messages  and  of  providing  graphical 
support  to  an  interactive  instructional  system.  For  example,  consider  a  dial.  Many  of  the  properties  of 
the  dial  actually  come  from  simpler  objects  which  can  be  used  in  a  variety  of  icons.  Figure  12  shows 
some  of  the  component  pieces  of  a  dial:  RECTANGULAR,  CONTINUOUS,  and  TAP  mixins.  For  any 
icon  that  displays  continuous  values,  we  mix  in  the  object  called  CONTINUOUS.  This  object  provides 
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FIGURE  8.  Icon  Sampler.  A  subset  of  the  graphical  icons  available  for  use  with  the  graphics  editor. 


a  place  to  hold  the  icon’s  value  and  the  minimum  and  maximum  values  the  icon  can  display.  The 
CONTINUOUS  mixin  also  provides  commands,  or  messages  any  instance  of  a  dial  icon  can  be  sent. 
CONSTRAIN -VALUE  is  an  example  message.  It  provides  a  way  of  constraining  a  number  to  be 
between  a  minimum  and  maximum  value.  Figure  13  shows  the  complex  structure  of  a  dial,  including 
its  instance  variables  and  the  messages  that  it  can  handle.  Of  course,  a  user  of  the  Graphics  Editor  does 
not  need  to  think  in  terms  of  these  implementation  details  but  need  only  be  concerned  with  critiquing 
visual  characteristics  of  the  dial  and  tapping  it  into  the  appropriate  variable. 

By  having  knowledge  stored  locally  in  icons,  the  Editor  and  Model  Controller  do  not  need  to  know 
about  how  the  dial  does  its  work.  Since  the  editor  does  not  need  to  know,  neither  does  the  view 
builder.  Icons  such  as  dials  or  pipes  understand  other  basic  messages  like  SHOW  which,  when 
received,  cause  the  receiving  icon  to  show  the  value  provided  in  the  message.  If  we  send  a  dial  the 
message  to  show  the  value  7,  it  reflects  that  value  by  positioning  its  needle.  On  the  other  hand,  if  we 
send  a  pipe  the  same  message,  it  shows  this  value  as  flow.  In  neither  case  did  we  explicitly  need  to 
know  how  the  icon  worked,  only  that  they  understood  the  message  sent.  These  messages  make  possible 
a  very  powerful  generic  interface  ability  which  has  been  exceedingly  useful  in  the  development  of  the 
simulation  environment. 


12  HOLLAN,  HUTCHINS.  McC  AND  LESS,  ROSENSTEIN,  *  WHTZMAN 


Tapping  Mechanism 

MATH  MODEL  GRAPHICAL  ICONS 


;;;Model  Augment  for  TAPPING  MECHANISM  Diagram 
(defun  tapping-mechanism-model-augment  () 

(when  model-running 
(if  (<  percent-valve-open  4) 

(setq  percent-valve-open  0)) 

(setq  pipe-speed  {//  percent-valve-open  100.0)) 

(if  («  clock-state  0) 

(setq  clock-state  1) 

(setq  clock-state  0)) 

(setq  valve-state  (if  (»  0  pipe-speed)  :off  :on)))) 

FIGURE  9.  Tapping  Mechanism.  A  depiction  of  the  relationships  between  variables  in  a  simple  mathematical  model  and  a  set  of 
icons.  Set  laps  allow  the  value  of  a  variable  to  be  changed  by  interacting  with  an  icon.  Probe  laps  cause  icons  to  reflect  the  value 
of  associated  variables.  At  the  bottom  of  the  figure  is  a  simple  model  augment  used  with  this  view. 


Icon  Editor 

While  the  Graphics  Editor  allows  one  to  construct  views  from  an  existing  set  of  icons,  the  Icon  Edi¬ 
tor  allows  users  to  construct  new  icons  which  can  dynamically  display  and  modify  the  state  of  a  simu¬ 
lation.  A  user  of  the  Icon  Editor  specifies  both  the  icon’s  appearance  and  behavior.  This  specification 
determines  the  graphical  states  for  the  icon.  For  example,  we  have  seen  the  appearance  of  a  dial  icon 
in  a  number  of  views.  The  behavior  of  the  dial  icon,  like  a  real  gauge,  comes  fh>m  the  ability  to  posi¬ 
tion  its  needle.  For  the  icons  of  the  Graphics  Editor  these  specifications  were  made  by  directly  writing 
Lisp  code.  Experience  with  the  Graphics  Editor  has  demonstrated  that  incremental  specification  and 
refinement  of  the  appearance  of  a  view  is  most  easily  effected  through  the  graphical  manipulation  of  its 
components,  the  icons.  The  Icon  Editor  mimics  this  facility  by  allowing  the  specification  of  an  icon’s 
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FIGURE  10.  Tapping  an  Icon.  Clicking  on  the  Up  menu  item  pops  up  a  window  in  which  probe  and  set  variables  can  be  speci¬ 
fied  as  well  as  constraints  and  mappings  of  their  values. 
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appearance  through  graphical  manipulation  of  the  components  of  the  icon  and  specification  of  its 
behavior  through  a  critiquing  process.  This  permits  the  development  of  a  hierarchy  of  graphical  primi¬ 
tives  for  use  in  the  appearance  of  icons  and  a  set  of  graphical  behaviors  for  icons.  Thus,  the  Icon  Edi¬ 
tor  is  a  tool  for  the  construction  of  icons  without  explicit  programming. 

A  number  of  the  Steamer  icons  can  be  thought  of  as  combinations  of  existing  icons.  The  digital  bar 
icon  in  Figure  14  consists  of  a  bar  icon,  a  banner  icon  and  a  rectangle  icon.  To  allow  positioning  these 
components,  the  same  graphical  techniques  available  in  the  Graphics  Editor,  such  as  marking  and  mov¬ 
ing,  are  also  available  in  the  Icon  Editor.  The  top  of  Figure  IS  shows  a  flame  icon.  In  a  number  of 
views,  flickering  of  this  icon  is  used  to  depict  the  flicker  of  an  actual  flame.  To  construct  the  icon  with 
the  Icon  Editor,  four  lines  were  incrementally  added.  The  Icon  Editor  thus  makes  possible  the  incre¬ 
mental  design  of  new  icons  from  basic  components. 

When  a  user  builds  a  view  in  the  Graphics  Editor,  the  system  is  writing  code.  This  level  of  activity 
is  entirely  invisible  to  the  user.  When  constructing  a  view,  the  user  has  no  feeling  of  coding,  of 
describing  the  procedure  the  computer  will  follow  to  reconstruct  and  run  the  view.  Similarly,  with  the 
Icon  Editor  we  don’t  want  a  person  constructing  an  icon  to  feel  that  they  are  writing  code.  Thus,  the 
Icon  Editor  must  make  available  an  appropriate  toolkit  of  behaviors  with  semantically  direct  representa¬ 
tion  for  each  behavior. 

It  is  unlikely  that  there  is  one  general  scheme  to  allow  builders  of  icons  access  to  primitive  graphical 
behaviors.  In  the  digital  bar  case,  the  component  icons  do  all  the  work.  The  builder  specifies  the 
behavior  of  the  digital  bar  by  constraining  its  tap  to  be  the  taps  for  the  bar  and  banner.  In  addition,  the 
designer  of  the  digital  bar  icon  must  decide  which  attributes  to  make  available  to  the  user  of  the  icon. 
In  the  Icon  Editor  a  pane  of  attributes  for  each  component  is  displayed.  The  user  can  constrain  two 
attributes  to  be  identical,  in  a  manner  similar  to  the  way  ups  were  constrained,  or  place  an  attribute  in 
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FIGURE  tl.  Mapping  a  Tap.  The  Upping  mechanism  allows  the  mapping  of  state  colon  and  variable  types.  Here  a  mapping 
has  been  made  between  a  logical  variable  and  the  on-off  sttte. 

the  color  or  miscellaneous  menus  for  use  in  the  Graphics  Editor.  For  the  digital  bar,  the  bar’s  color  and 
the  banner’s  text  color  would  be  placed  in  the  color  menu.  Since  bar,  rectangle,  and  banner  have 
labels,  the  icon  builder  would  not  put  any  of  the  label  attributes  of  the  components  in  the  menu.  This 
prevents  the  user  of  the  icon  from  accidentally  placing  labels  in  incorrect  positions.  The  Icon  Editor 
also  provides  color  and  miscellaneous  buttons,  to  allow  the  builder  to  check  the  appearance  of  the 
menus  as  they  are  built 

The  flame  icon  provides  a  more  interesting  case,  one  in  which  behavior  is  synthesized  at  the  level  of 
the  new  icon.  The  flickering  action  of  flames  is  implemented  using  animation.  Rotating  the  colors  of 
the  four  lines  which  comprise  a  flame  creates  the  flickering  effect.  A  better  effect  is  produced  by 
maintaining  a  fixed  color  for  one  of  the  lines.  At  the  bottom  of  Figure  IS  are  the  three  possible  anima¬ 
tion  states.  When  rotation  repeats  in  real  time,  the  flame  appears  to  be  flickering.  Underlying  the  ani¬ 
mation  is  a  complex  negotiation  between  the  icon  and  the  graphics  device,  but  the  builder  needs  only  to 
specify  the  three  rotation  colors. 

Figure  16  shows  an  experimental  configuration  for  the  Icon  Editor  in  which  a  flame  is  being 
designed.  Near  the  bottom  of  the  figure  is  the  status  line  showing  the  current  icon  (flame).  Across  the 
middle  of  the  screen  is  a  pop-up  menu  an  icon  user  would  see  in  the  Graphics  Editor  for  specifying 
color.  The  topmost  pane  allows  a  icon  builder  to  examine  other  Graphics  Editor  menus  created  from 
the  construction  of  an  icon. 

We  are  in  the  process  of  implementing  additional  behaviors  for  the  Icon  Editor.  These  include 
allowing  an  icon  to  move  along  a  trajectory  and  to  vary  the  hue  of  its  color  to  reflect  the  value  of  a 
tapped  variable.  The  initial  goal  for  the  Icon  Editor  is  to  be  able  to  reimplement  the  Steamer  icons 
using  the  Icon  Editor.  We  are  using  this  reimplimentation  to  assist  us  in  identifying  a  set  of  primitive 
components  sufficiently  rich  to  permit  specification  of  the  diverse  set  of  behaviors  exemplified  in  the 
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Internal  Icon  Structure  -  Dial 


MIXINS 

Dial  Rectangular  Continuous  Tap 


NEW  FLAVOR 


FIGURE  12.  Components  of  a  Dial  Icon.  Some  of  the  mixins  which  make  up  a  dial  icon.  Each  mixin  contributes  instance  vari¬ 
ables  (top  half  of  boxes)  and  messages  (bottom  half  of  boxes). 


Steamer  icons  and  as  a  method  for  exploring  interface  techniques  for  making  the  primitive  behaviors 
available  to  a  user. 

Knowledge-Base  Editors 

We  are  in  the  process  of  designing  and  implementing  a  set  of  editors  to  assist  an  instructional 
designer  or  other  simulation  interface  builder  in  specifying  knowledge  about  a  system.  A  data  base  of 
knowledge  is  required  to  integrate  information  about  both  the  domain  and  the  purposes  of  particular 
interfaces.  This  knowledge  can  be  employed  to  allow  simulation  views  to  be  able  to  describe  them¬ 
selves,  run  scenarios  of  simulation  activities,  pose  questions  to  be  answered  by  interacting  with  a  view 
or  collection  of  views,  and  to  perform  other  forms  of  instructional  activities.  To  facilitate  the  specifica¬ 
tion  of  the  data  base  of  knowledge  we  have  designed  four  additional  editors:  a  Knowledge  Editor  with 
a  graphical  interface,  a  Lesson  Editor,  a  Behavior  Editor,  and  a  Graphical  Design  Editor. 


Knowledge  Editor  and  Grapher 

We  are  using  a  frame-based  knowledge  representation  facility  originally  designed  by  Bruce  Roberts 
of  BBN,  Cambridge,  Massachusetts.  It  essentially  builds  a  class  structure  on  top  of  Flavors  to  provide 
frame-based  representational  facilities.  The  underlying  language  is  called  MSG,  for  its  flavor  enhancing 
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DIAL 

all  Instance  variables  (43) 

ARC-END  (DIAL) 

ARC-START  (DIAL) 

DIRGRRN  (SRSIC-ICON) 

OX  (RECTANCULAR-MXIN)' 

DT  (  RECT ANGULAR-NIXIN ) 

FACE-COLOR  (GAGS-HIXIN) 

FRACTIONAL-CHANGE-TO-SHOU  (CONTINUOUS-NIXIN) 
FSflflE  (PICTURE-NIXIN) 

INVERSE-NATEIX  (RECTAHGULAR-WXIN) 

LABEL -COLOR  (GAGE-HIXIN) 

LABEL-COLOR  (RECTRNGULAR-NIXIN) 

LABEL-FONT  (RECTRNGULAR-NIXIN) 
LABEL-ORIENTATION  (RECT RNG’JLRR-fll XI N ) 
LABEL-POSITION  (GAGE-HIXIN) 

LABEL-POSITION  (RECT ANGULAR-NIXIN) 
LABEL-STRING  ( RECT ANGULAR-fll XIN) 

LOCATIONS  (  DISPLAY -M  XIN) 
tlATRIX  (REC7ANGULAR-MXIN) 

NAX-VALUS  (CONTI NUOUS— NI XIN) 

n in- value  (cohtinuous-rixin) 

NEEDLE-COLOR  (DIAL) 

OUTLINE-COLOR  (RECTRNGULAR-NIXIN) 

RADIUS  (DIAL) 

RANGE  (CONTInuOUS-NIXIH) 

REDLINE -VALUE  (DIAL) 

TfiP-tlRP  (TAP-nlXIN) 

TAP-NAPPING  (TAP-NIXIN) 

TAP-PROBE  (TAP-RIXIN) 

TAP-READING  (TAP-NIXIN) 

TAP-SET  (TAP-NIXIN) 

TIC-LHBELS-COLOR  (GRGc-NIXIN) 

TIC-LAcELS-PONT  (GRGc-NIXIN) 

TICS  (GP.GS-NIXIN) 
units-color  (GSGE-NIXIN) 

UNITS-FONT  (GRGE-HIXIN) 

UNITS-STRING  (GRGc-NIXIN) 

VALUE  (CONTINUOUS-NIXIN) 

XC  (REOTRNGULHR-NIXIN) 

XL  (RECTRNGULAR-NIXIN) 

XR  (RECTRNGULAR-NIXIN) 

YB  ( RECT ANGULAH-HI XIN) 

YC  (RECTRNGULAR-NIXIN) 

YT  (RECTRNGULAR-NIXIN) 


all  handlers  (70) 

jfifilnATE  pr Inary  deenon  ICON: DrSPLAY-NIXIN 

SfiSPEIT-RATIO  prlnery  daenon  ICONiSOURRE-RSPEIT-RATIO-NIXlN 

{BORDER  prlnary  daenon  ICON; RECT ANG’JLRR-NIXIN 

i  BOUNDING -RECT  ANGLE  prlnary  deenon  I CON : RECT  ANGULAR -HI  XI N 

: CHANGE-FLAVOR  prlne.-y  deenon  ICOH:SHSIC-ICON 

iCLRIN  notype  or  ICONsRECT ANGULAR-NIXIN 

:  CLAIN-RECT  ANCLE  prlnary  daenon  I  CON:  RECTRNGULAR-NIXIN 

sCONPUTE-NAPPING  prlnary  daenon  ICON: TRP-NIXIN 

{CONFUTE-PROEE  prlnary  deenon  ICON:  TRP-NIXIN 

sCONPUTE-SET  prlnary  daenon  ICON:TRP-HIXIN 

jCOnP'JTE-TAP  prlnary  daenon  ICON: TRP-NIXIN 

:  C  ONE  *  RAI N-VRLUE  prlnary  daenon  ICON:CONTINUOUS-N:XIH 

:  DISPLAY -PICTURE  prlnary  daenon  ICON  :PICTURE-NI  XIN 

:DRHU  canblned  daenon  ICON:DIAL 

:DRAL'-LP.SEL  prlnary  daenon  ICON.-RECTRNC’JLAR-NIXIN 
: DRAW-NEEDLE  prlnary  daenon  ICON:DIAL 
: DRSL'-TIC-LABELS  prlnary  daenon  ICON:DIAL 
:DRRL'-TICS  prlnary  daenon  ICON:DIAL 
{DRAW-UNITS  prlnary  daenon  1C0N:DIAL 
{DRAW- VALUE  prlnary  daenon  ICON:DIAL 
sEDIT-POSITION  prinary  daenon  ICON:RsCTANGULAF.-nix:H 
: ERASE  ecnblned  dae.-.en  ICON : DIAL 

:ERP.SE-LAH£L  prlnary  daenon  I  CON :  RECT  HNGULRR-NIXI N 
{EXT  ENDED- BOUNDING -SECT ANGLE  prlnary  daenon  ICON:RECTANGUL?.S-NI] 
{GET-.ELL-INSTANCE-VRRIAELES  prlr.ary  daer.on  ICONiSr.SIC-ICON 
I GET-CCNPONENT -FLAVORS  prinary  daenon  ICON: BASIC-ICON 
2 HIGHLIGHT  contained  dae.ncn  ICON:DIRL 

sHI GHLI GHT -NOHENT RRILY  prinary  daenon  ICON:DIS.=LAY-HIXIN 
{HIGHLIGHT -POINTS  prlnary  daenon  I CDH : RECTANGULAR -NI XI N 
SlHIT  contained  daenon  ICON:DIAL 
i INVERSE-PROBE  prlnary  daenon  IC0N:TAP-NIXIN 
{INVERSE-SHOW  prlnary  daer.on  ICON:CONTINUOUS-NIXIN 
:LRS£L-?QSITIOH-nUX  prlnary  deenon  ICON:RECIAHGULSE-NIXlH 
sLATCH  prlnery  daenon  ICON:RECTnHGULAR-HIXIN 

{LEGAL-LABEL -POSITIONS  prlnary  tszr.cn  ICON:NO-CENTER-LA=D.-r,IXII 

t LOCATION  prinary  daenon  ICON:DISPLHY-NIXIH 

tKAKS-PLIST  prlnary  daenon  ICON: SASIC -I CON 

SNODIFY-NIX  prlr.ary  daenon  IC0N:SHSIC-ICON 

:NOV£-?.ELATIVE  prlnery  daenon  ICON:  SECT  ANGULAR-NIXIN 

SNORNALI-E  prlnery  dae.ncn  I  CON :  SECT  ANGULHR-HI XI N 

iPROEE  prinary  daer.on  ICON:THF-NIXIN 

:PROEE?  prlnary  daer.en  ICOH:TA?-NIXIN 

{READING  prlnary  daer.on  ICON: Trr-HIXIN 

sPROEE  prinary  daenon  ICON:THF-nlXIN 

:?R3SE7  prlnary  daanon  ICON-.TAF-NIXIN 

{READING  prlnary  daenon  IC0N:TRP-HIXIH 

:RECCr, AUT E-DERI VE3-?ARRnET ESS  contained  deenon  ICON : 01 AL 

{REFLECT  contained  deenon  IC0N:DIRL 

:RENA<E-FORn  prinary  daenon  IC0N:SP.£IC-IC0N 

:SET  prlnary  daenon  ICON: TAP-NIXIN 

:SET-ECUNOING-RECT ANGLE  prlnary  daenon  ICON:REC:RNGULAF.-HIXIN 

:SET-LOCariOH  prlnery  deenon  ICON: DISPLAY -HIXIN 

: SET -T AP-NAPPI NC  contained  daenon  IC0N:DIAL 

(SET-TAF-PROBE  contained  daenon  IC0N:DIRL 

:SET-TA?-EET  contained  daenon  I CON: DIAL 

:SET?  prlnary  daenon  ICON: TAP-NIXIN 

{SETUP  contained  daenon  IC0N:DIRL 

{SETUP-COLOR  prinary  daenon  ICON:SeTUP-MXIN 

{SETUr-COLOR-VRLUES  prlnary  daenon  IC0N:0IAL 

{SETUP-LASEL  contained  daenon  IC0N{DIAL 

{  SET  UP  -HI  SCELL  ANEOUS  prlnary  daenon  ICON:SETUP-NIXIN 

{SETUP-NISCELLANEOUS-VALUES  prlnary  daenon  IC0N:3IAL 

{SETUP-HOVE  contained  daenon  IC0N:3IRL 

(SETUP-PICTURE  prinary  daenon  ICOn:PICTURE-niXIN 

{SETUP-POSITION  contained  daenon  ICON:0IRL 

{SETUP-ROTATION  contained  daenon  ICONiDIHL 

(SETUP-TAP  contained  daenon  IC0N(DIAL 

(SHOU  contained  daenon  IC0H:DIRL 

(SHOU-NEU- VALUE?  prinary  daenon  ICON: CONTINUOUS-NIXIN 
{TAPPED? .prlnary  daenon  ICON: TRP-NIXIN 
{THINGS-TO-SRVE  contained  append  IC0N:DIHL 
{TQ-SHOU  prlnary  daenon  XCQN:DIAL 
:Z00n  contained  daenon  IC0N:DIRL 


FIGURE  13.  Dial  Icon  Details.  A  listing  of  the  43  instance  variables  and  70  messages  actually  contributed  to  a  dial  icon  by  the 
full  let  of  its  mixins. 
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Digital  Bar 


Rectangle 


FIGURE  14.  Components  of  a  Digital  Bar. 


FIGURE  IS.  Flame  Icon.  The  top  portion  of  the  Figure  (hows  the  complete  icon.  At  the  bottom  is  an  animation  sequence. 


capability.  Here  we  present  an  overview  of  its  representational  capabilities  and  our  implementation  of  a 
graphical  interface  to  it  The  MSG  language  provides  the  facility  to  define  classes  of  objects.  Each 
class  defines  local  attributes  that  distinguish  it  from  the  other  classes.  It  is  the  instances  of  these 
classes  that  we  use  to  represent  the  objects  in  a  world  being  modeled.  In  the  hierarchy  of  the  class 
structure,  a  class  may  have  any  number  of  abstractions  or  superior  classes.  A  given  class  will  inherit 
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FIGURE  16.  Icon  Editor.  Screen  configuration  of  the  Icon  Editor. 


all  of  the  attributes  of  its  abstractions.  By  defining  additional  atiributes  at  the  local  level,  a  class  can  be 
made  more  specific.  The  inheritance  mechanism  allows  the  inheritance  of  roles  and  slots.  A  role  is  the 
semantic  organization  of  a  set  of  attributes,  while  a  slot  provides  an  actual  placeholder  for  an  attribute. 
In  addition,  the  system  provides  a  co-reference  facility,  the  ability  to  reference  the  same  attribute  of  a 
class  using  multiple  descriptions. 

When  a  new  class  is  defined,  an  instance  of  a  meta-class  is  created  that  will  hold  all  pertinent  infor¬ 
mation  about  the  class.  This  includes  how  to  create  a  new  class  instance,  where  to  store  these 
instances,  and  how  to  manipulate  them.  When  a  new  class  is  defined,  a  new  flavor  is  also  defined. 
The  name  of  this  new  flavor  is  the  same  as  the  name  of  the  class  being  created.  When  instances  of  a 
class  are  created,  an  instance  of  the  associated  flavor  is  made.  The  instance  variables  of  a  class  provide 
the  typical  role  and  slot  descriptors  of  a  frame-based  representational  language.  A  role  consists  of  a 
role  name  and  a  list  of  slots  which  make  up  the  role.  A  slot  provides  a  name  and  the  potential  of 
specifying  restrictions  and  default  values.  In  addition,  the  language  provides  for  subroles  to  further 
refine  roles.  Figure  17  shows  an  example  of  the  MSG  representation  of  a  two  port  fluid  device. 

To  access  the  value  of  a  slot  of  an  instance,  a  path  to  that  slot’s  value  is  constructed.  For  example, 
the  class  of  fuel-oil-service-pump  has  an  instance  called  fosp-alpha  and  a  slot  called  inlet-valve.  To 
return  the  fosp-alpha’s  inlet-valve  you  would  construct  the  path:  (the  fosp-alpha  inlet-valve).  This 
would  return  the  object  that  is  fosp-alpha’s  inlet-valve.  If  this  value  happens  to  be  another  object,  one 
can  access  a  slot  of  the  new  object  by  adding  onto  the  path.  If  the  inlet-valve  has  a  slot  called  inlet 
you  could  expand  the  path  to  (the  fosp-alpha  inlet-valve  inlet),  which  would  return  the  inlet  of  the 
fosp-alpha’s  inlet-valve. 

An  important  feature  of  the  MSG  language  is  co-reference,  the  ability  to  reference  the  same  class 
element  by  different  descriptors.  Paths  and  synonyms  play  an  important  role  in  providing  this  facility. 
When  a  synonym  is  defined,  a  co-reference  is  built  and  used  instead  of  the  actual  object  The 
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Th«  2 -PORT -FLUID- DEVICE 

Description  j  device  tflth  two  fluid  ports 

;ftb«trecC<o«f  i  (FLUID-DEVICE  2 -PORT -DEVICE) 

Used  ss  flfi street Ions*  (FLUID-PATH  URLV6  FLUID-SINK-UITM-QUTLET  FLUID-SOURC£-«ITH-INl  I 
ET  ISO-2-PORT-reviCE  FLOU-THROUGH-PIRHIFOLD  DCVICE-UITM-BYPRSS  SUCTION-DEVICE) 

Hvnber  of  Instances  :  I 

Connections  t  HIL 

Synonyns  :  HIL 

•Role:  PARTS 
•Role:  PORTS 

•Slot:  (INLET  (R  FLUID-PORT)  (ft  FLUID-PORT)  HIL) 

•Slot:  (OUTLET  (R  FLUID-PORT)  (R  FLUID-PORT)  NIL) 
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FIGURE  17.  MSG  Representation  of  a  Two  Port  Fluid  Device.  This  results  from  pointing  to  2-port-fluid-device  and  asking  for  a 
description  of  the  class. 


co-reference  includes  the  actual  object  and  the  multiple  paths  to  access  the  object.  The  data  structure 
of  a  synonym  is  a  list  of  synonym  pairs.  Each  member  of  a  pair  defines  a  path  to  a  slot  which  is 
synonymous  with  the  slot  found  at  the  end  of  the  path  of  the  other  member  of  the  pair.  For  example, 
the  synonym  ((inlet-valve  inlet)  (suction))  states  that  the  inlet  of  the  inlet-valve  is  the  same  as  the  suc¬ 
tion  slot 

KE-GRAPHER  is  a  tool  to  create,  maintain,  and  inspect  MSG  objects  using  a  graphic  representation 
of  the  knowledge  class  hierarchy.  It  incorporates  a  graphing  facility  to  display  the  class  hierarchy  with 
the  nodes  of  the  graph  becoming  mouse  sensitive.  Examples  are  shown  in  Figures  17  and  18.  The 
window  is  divided  into  four  parts:  the  title,  the  main  graphing  area  which  presents  the  class  hierarchy,  a 
margin  choice  area  to  select  top  level  commands,  and  a  keyboard  input  pane  to  change  the  objects  to  be 
graphed.  The  starting  nodes  of  graphs  are  called  roots.  After  a  user  types  in  an  expression  that  will 
evaluate  to  the  name  of  a  class  or  a  list  of  classes,  the  window  will  reset  the  roots  and  regraph  the  win¬ 
dow.  If  the  item  evaluated  is  not  the  name  of  a  class  but  the  name  of  a  flavor,  then  that  flavor  and 
those  that  depend  on  it  will  be  graphed.  One  can  pan  around  the  graph,  zoom  its  size  larger  or  smaller 
by  changing  font  sizes,  hardcopy  the  graph,  and  save  or  load  a  class  File  from  disk.  Each  node  of  the 
graph  is  mouse  sensitive  and  via  various  button  clicks  one  can  describe,  create,  move,  or  edit  a  class. 
Similar  facilities  are  provided  for  manipulating  instances  and  flavors. 


Lesson  Editor 

The  Lesson  Editor  activity  provides  interface  b  rilders  the  ability  to  add  instructional  sequences  to  a 
simulation.  In  the  current  version  of  the  Simulation  Environment,  the  Lesson  Editor  Screen  appears  as 
in  Figure  19.  It  maintains  the  full  range  of  Model  Control  facilities  while  supplying  additional 
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FIGURE  18.  Graphical  Interface  for  MSG  and  Flavors  System.  A  graph  of  ihe  dependencies  between  classes.  Individual  nodes 
in  the  graph  are  mouse  sensitive  Clicking  on  an  item  gives  a  menu  of  actions  that  can  be  performed  on  it. 


functions  for  creating  and  editing  lesson  sequences.  These  sequences  are  made  up  of  sets  of  actions 
each  of  which  are  tied  to  some  behavior  within  the  running  of  a  simulation.  Each  action  can  either 
display  text  or  affect  the  state  of  the  simulation  in  some  way. 

The  Lesson  Display  Window  shows  a  partial  script  of  feedback  lesson  segments.  This  script  could 
be  used  to  show  a  feedback  relationship  in  the  Make  Up  and  Excess  Feed  System.  The  first  segment 
indicates  an  action  to  set  the  variable  DFT  (the  level  of  a  tank)  to  825.0.  The  next  segment  is  a  condi¬ 
tion  which  waits  until  the  DFT  is  below  850.  When  that  level  is  achieved,  a  set  of  icons  is  highlighted 
and  text  beginning  with  "When  the  DFT..."  will  be  presented  to  the  student.  The  highlighted  icons  con¬ 
sist  of  the  components  in  a  feedback  loop  which  attempts  to  maintain  the  DFT  between  895  and  1105. 
These  script  segments  are  added  to  the  lesson  by  choosing  a  command  in  the  Segments  pane.  The 
commands  allow  the  user  to  present  text  to  the  student  highlight  a  set  of  icons  of  current  importance, 
pause  the  presentation  until  a  salient  event  occurs,  set  an  icon  to  a  value,  and  execute  an  arbitrary  func¬ 
tion.  Much  of  this  specification  is  done  graphically.  For  example,  setting  the  level  of  the  DFT  in  this 
script  was  accomplished  by  pointing  to  the  appropriate  level  in  the  iconic  depiction  (the  DFT  tank  in 
Figure  4).  Each  segment  can  be  edited,  deleted,  undeleted,  or  moved  within  a  lesson.  Lessons  can  be 
saved,  read  in  from  files,  and  performed  to  see  the  exact  sequence  that  will  be  presented  to  the  student. 

We  currently  are  in  the  process  of  expanding  the  Lesson  Editor  so  that  a  user  can  employ  knowledge 
which  has  been  provided  about  simulation  objects  and  views  to  construct  instructional  descriptions  of 
components  and  behaviors  within  the  simulation.  We  are  also  designing  instructional  systems  which 
will  gather  information  about  a  student’s  knowledge  of  a  domain  by  monitoring  interactions  with  the 
simulation.  This  system  will  pose  questions  to  students,  which  are  to  be  answered  by  interacting  with 
graphical  views. 
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FIGURE  19.  Lesson  Editor.  Screen  configuration  for  control  of  lesson  editing  activity.  The  result  of  interacting  with  a  graphical 
view  to  specify  a  portion  of  a  lesson  sequence  is  also  shown. 
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One  obstacle  to  a  domain  expert’s  ability  to  use  the  Graphics  Editor  to  construct  an  interface  for  a 
domain  is  the  requirement  of  an  existing  mathematical  model  of  the  domain.  Even  if  a  model  is  avail¬ 
able  it  is  unlikely  that  a  domain  expert,  without  significant  additional  effort,  will  have  sufficient  under¬ 
standing  of  the  simulation  model  to  be  able  to  tap  icons  into  it  The  Behavior  Editor  is  an  initial 
exploration  of  a  tool  that  would  eliminate  the  need  for  an  undei  lying  simulation  model.  The  icons  in 
the  Graphics  Editor  know  how  to  "appear"  in  order  to  represent  the  status  of  variables  to  which  they  are 
tapped,  but  the  behavior  of  the  system  is  defined  by  a  simulation  model.  The  Behavior  Editor  is  com¬ 
posed  of  icons  that  know  aspects  of  both  the  behavior  and  the  appearance  of  the  objects  they  represent. 
The  behavior  of  the  system  emerges  from  the  interactions  of  the  icons  with  each  other.  The  ability  to 
incorporate  the  behaviors  required  in  a  simulation  is  facilitated  by  the  object-oriented  implementation  of 


To  make  intelligent  icons  capable  of  generating  a  simulation,  it  is  necessary  to  add  components  with 
domain  and  simulation  knowledge.  We  have  built  a  number  of  icons  that  "know"  the  rudiments  of 
fluid  dynamics  and  understand  about  connections  to  other  icons.  These  include,  for  example,  tanks  and 
pipes  that  know  about  pressure  and  flow,  so  they  can  be  used  in  fluid  systems.  Figure  20  depicts  a 
very  simple  system  constructed  in  exactly  the  same  manner  as  with  the  Graphics  Editor,  but  involving 
behaviorally  "smart"  icons  that  can  be  connected  together.  These  icons  have  mechanisms  for  recogniz¬ 
ing  when  connections  should  be  made  and  thus  the  topology  of  the  view  is  automatically  generated. 

An  excellent  example  of  the  flexibility  engendered  by  icons  with  connectivity  knowledge  is  the 
Super  Sensor.  This  icon  is  a  dial  that  asks  icons  it  connects  to  what  variables  can  be  monitored  and 
which  variable  to  measure  by  default  In  Figure  20  notice  that  a  Super  Sensor  is  connected  to  the  left 
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FIGURE  20.  Behavior  Editor  View.  Three  points  in  lime  in  the  operation  of  a  simple  tank  and  pipe  view  constructed  with  the 
Behavior  Editor.  A  Super-Sensor  dial  has  been  connected  to  one  Unk  and  automatically  reads  the  level  of  the  tank. 

tank  to  monitor  its  level.  Sensors  know  how  to  monitor  appropriate  aspects  of  the  objects  to  which 
they  are  connected.  Users  can  manipulate  these  aspects  by  clicking  on  the  Miscellaneous  menu  item  on 
the  Behavior  Editor  screen  (Figure  21).  The  sensor  has  defaulted  to  measure  value,  which  is 
highlighted.  The  sensor  can  be  changed  to  measure  fluid  exchanged  by  clicking  on  that  menu  item. 
When  users  interact  with  the  tanks,  setting  their  levels,  we  are  actually  setting  the  initial  conditions  of 
the  simulation.  On  the  Behavior  Editor  screen  (Figure  21),  they  can  then  click  on  run,  and  the  simula¬ 
tion  will  run  until  equilibrium.  It  is  important  to  notice  a  fundamental  difference  between  the  Behavior 
Editor  and  the  Graphics  Editor.  In  the  Graphics  Editor,  the  designer  would  need  a  mathematical  model 
of  the  tanks  and  pipes  and  then  it  would  be  necessary  to  find  the  appropriate  variables  to  tap  the  icons 
into.  Here,  the  icons  themselves  perform  the  required  computations  for  the  simulation. 

Designer 

Designer  evolved  out  of  our  development  experiences  with  Steamer.  We  found  that  instructors  using 
the  Graphics  Editor  sometimes  created  views  that  violated  simple  graphic  design  rules.  They  also  had 
difficulty  maintaining  stylistic  conventions  across  sets  of  views.  Designer  is  a  general  tool  for  assisting 
with  the  design  process.  It  functions  as  an  interactive  visual  design  consultant  for  users  of  the  Graphics 
Editor  and  is  intended  to  aid  developers  by  providing  graphic  expertise  during  the  construction  and 
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FIGURE  21.  Behavior  Edaor.  Screen  configuration  of  the  Behavior  Editor  during  the  process  of  connecting  a  super  sensor  to  a 
tank. 


critiquing  of  graphical  views.  This  expertise  includes  graphic  design  principles  as  well  as  standards  of 
presentation.  The  underlying  motivation  is  to  improve  the  quality  of  the  views  by  making  them  more 
consistent  and  visually  more  effective.  In  addition  to  merely  describing  design  alternatives,  the  system 
allows  exploration  of  the  design  space  by  explaining  the  advantages  and  disadvantages  of  alternative 
design  solutions.  Through  interactive  dialogue  and  constructive  examples,  the  system  tutors  users  of  the 
Graphics  Editor  in  principles  of  graphic  design. 

Designer  consists  of  three  interrelated  processes,  an  Analyzer ,  a  Critiquer,  and  a  Synthesizer,  coupled 
to  a  domain  dependent  knowledge  base.  This  knowledge  base  consists  of  design  elements  and  relation¬ 
ships,  techniques  for  their  identification,  and  sets  of  constraints  used  in  distinguishing  good  design  from 
bad  The  Analyzer  first  parses  the  design  based  on  the  elements  and  relationships  of  the  given  domain. 
The  Critiquer  uses  this  information  to  indicate  where  the  current  design  fails  to  conform  with  the  princi¬ 
ples  of  good  design  or  predetermined  guidelines.  Finally,  based  on  searches  of  the  design  space,  the 
Synthesizer  suggests  alternative  modifications  to  the  current  state  of  the  design.  The  separation  of  these 
three  processes  from  the  knowledge  base  provides  independence  and  modularity  to  the  system. 

Domain-based  design  constraints  are  the  basis  of  the  critiquing  process.  Constraints  within  Designer 
consist  of  both  basic  graphic  design  principles  important  in  the  construction  of  two-dimensional  views 
and  sets  of  view  standards  that  are  adopted  for  particular  domains.  The  combination  of  principles  and 
standards  create  a  context  or  Style  in  which  the  design  critique  and  subsequent  modifications  take  place. 
By  modifying  the  style  within  which  a  critique  is  made,  one  can  ultimately  affect  the  form  of  the  final 
design.  It  thus  becomes  possible  to  request  multiple  critiques,  each  based  on  a  different  style.  This  is 
an  especially  powerful  paradigm  for  designs  that  may  need  to  be  presented  in  different  media,  each 
with  different  constraints  that  need  to  be  considered.  For  example,  a  style  appropriate  for  a  high- 
resolution  color  display  may  be  inappropriate  for  a  black  and  white  hardcopy  presentation. 
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An  initial  implementation  of  Designer  has  been  completed.  A  functioning  Analyzer  and  Critiquer 
used  on  existing  Steamer  views  have  provided  useful  feedback.  It  is  very  encouraging  that  even  in 
views  that  we  had  thought  were  carefully  crafted,  the  system  has  been  able  to  note  inconsistencies  and 
suggest  improvements.  Progress  has  been  made  in  identifying  the  basic  elements,  relationships,  and 
principles  of  two-dimensional  graphic  design  and  incorporating  them  into  Designer’s  processes.  The 
Analyzer  fust  evaluates  design  elements  in  terms  of  their  size,  shape,  color,  and  location  and  then  iden¬ 
tifies  relationships  between  them  from  information  provided  in  the  knowledge  base.  These  relationships 
include  similarity,  proximity,  grouping,  and  repetition.  As  new  relationships  are  identified,  they  can 
easily  augment  the  analysis  process.  Various  techniques  exist  to  interactively  inspect  the  elements  and 
relationships  identified  within  the  design. 

The  Critiquer  locates  examples  and  violations  of  the  design  constraints  provided  in  the  current  style 
and  creates  a  critique.  These  comments  include  descriptions  and  justifications  based  on  the  graphic 
constraints  from  which  they  were  derived.  Since  the  Critiquer  works  within  the  context  of  a  current 
style,  there  are  facilities  to  help  define  graphic  constraints  and  maintain  styles.  A  preliminary  graphic 
constraint  language  allows  the  creation  of  new  constraints,  while  a  style  editor  has  been  developed  to 
create,  maintain,  and  switch  between  styles. 

Figure  22  shows  Designer’s  top-level  user  interface.  The  multipaned  interface  provides  access  to 
existing  Graphics  Editor  functions  and  new  Designer  functions  through  scrolling  command  panes  (upper 
right  collection  of  panes).  Access  to  the  domain  knowledge  is  provided  in  a  mouse  sensitive  graphing 
pane  (upper  left  pane).  Comments  of  constraint  violations  are  displayed  in  a  scrolling  pane  (lower  left 
pane),  while  descriptions  of  the  violations  can  be  displayed  in  the  lisp  interaction  pane  (lower  left 
pane).  In  Designer,  the  status  line,  consistent  throughout  the  simulation  environment,  includes  the 
current  style  in  which  the  analyses  take  place. 
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FIGURE  22.  Designer.  Screen  configuration  of  Designer. 


mm 


WWW 


GRAPHICAL  INTERFACES  25 


CONCLUSIONS 

Interface  design  is  currently  very  much  more  of  an  art  than  a  science.  There  is  a  tremendous  need 
for  better  theories  of  interface  design  and  for  more  powerful  tools  to  assist  in  their  design  and  imple¬ 
mentation.  Currently  there  is  virtually  no  theory  of  interface  design.  We  do  not  even  understand  what 
contributes  to  the  effectiveness  of  the  most  successful  interfaces.  We  are  in  a  state  similar  to  when 
bridges  were  built  by  copying  existing  bridges  without  knowing  in  advance  what  would  result  from 
even  the  most  minor  variation.  We  need  a  more  principled  base  for  the  design  of  interfaces,  one  that 
characterizes  the  dimensions  of  the  space  of  interfaces.  Such  a  theoretical  characterization  is  the  only 
way  to  be  able  to  understand  and  intelligently  make  the  myriad  of  tradeoff  decisions  inherent  in  inter¬ 
face  design.  Hopefully  it  is  clear  from  this  chapter  that  we  think  a  theory  needs  to  be  erected  from  an 
understanding  of  interfaces  as  representational  languages  and  based  on  an  appreciation  of  the  cognitive 
tasks  that  people  are  employing  such  representational  systems  to  solve. 

One  of  the  factors  that  influences  the  development  of  a  theory  of  interface  design  is  that  computer- 
based  interfaces  enable  new  forms  of  representational  languages  that  are  different  in  fundamental  ways 
from  more  traditional  representational  systems.  While  most  representational  languages  are  static,  these 
interfaces  make  possible  dynamic  languages.  For  example,  when  we  use  natural  languages  or 
mathematical  notation  to  represent  our  knowledge  about  the  world,  the  representational  system  itself  is 
fundamentally  static.  The  "action"  comes  from  our  interpretation  of  it.  Compare  this  with  a  interactive 
graphical  interface  to  a  simulation.  The  representational  system  itself  now  can  "behave,"  both  in  terms 
of  reflecting  state  and  in  allowing  us  to  directly  manipulate  it.  We  still  are  involved  in  a  process  of 
interpretation  but  it  now  concerns  behaving  entities.  The  interface  becomes  a  kind  of  dynamic  world  in 
which  we  can  think  of  and  interact  with  objects  as  if  they  were  the  things  themselves.  Elsewhere  we 
discuss  this  very  different  metaphor  for  interface  design  (Hutchins,  Hollan,  &  Norman,  1986).  The 
point  here  is  that  this  is  a  novel  form  of  representational  system  and  one  which  we  know  very  little 
about. 

One  of  the  appeals  of  these  new  forms  of  representational  systems  are  the  parallels  that  exist  between 
them  and  the  forms  of  representation  we  employ  in  perception.  When  one  interacts  with  the  world,  the 
world  changes  and  those  differences  are  reflected  in  our  perception.  Interactive  interfaces  provide  a 
similar  form  of  behavior:  we  pick  up,  move,  or  otherwise  modify  some  object,  and  the  associated  object 
in  the  simulation  world  changes.  As  we  discussed  earlier,  this  form  of  representation  allows  us  to 
employ  a  number  of  very  effective  strategies  and  to  do  what  we  are  particularly  good  at  doing:  detect¬ 
ing  patterns,  constructing  mental  models  or  simulations  of  the  world  that  support  causal  reasoning,  and 
manipulating  the  world  by  actions  on  it  or  on  representations  of  it.  The  ability  to  bring  an  increasing 
portion  of  a  dynamic  world  into  the  realm  of  the  perceptually  knowable  is  surely  one  of  the  major 
appeals  of  these  new  forms  of  interfaces.  It  is  clear  from  our  experiences  developing  Steamer  that  there 
is  much  power  from  interfaces  that  provide  a  form  of  conceptual  fidelity.  By  this  we  mean  interfaces 
that  have  characteristics  similar  to  those  normally  attributed  to  people’s  mental  models.  These  include 
the  depiction  of  state,  topology,  hierarchical  embedding,  and  the  ability  to  run  the  models  to  make  pred¬ 
ictions  about  the  consequences  of  changes. 

Another  conclusion  we  have  reached  about  graphical  interfaces  derives  from  their  ability  to  serve  as 
filters  of  information.  In  most  of  the  applications  we  have  built  there  is  an  underlying  simulation  or 
real-time  system.  The  collection  of  graphical  views  that  comprise  an  interface  to  an  underlying  system 
can  be  conceived  of  as  being  a  set  of  filters  of  information.  The  designer  of  a  view  filters  information 
by  selecting  what  and  how  to  display  it  Of  particular  interest  to  us  has  been  the  ways  filtering  can  be 
employed  to  support  the  development  of  particular  mental  models.  For  example,  a  message-passing 
abstraction  of  a  system  can  be  given  a  graphical  instantiation  and  thus  serve  to  highlight  characteristics 
not  normally  available  and  provide  an  effective  way  of  thinking  about  the  system.  Often  in  Steamer  we 
have  found  it  advantageous  to  filter  quantitative  information  and  present  it  qualitatively.  One  of  the 
very  real  problems  in  understanding  dynamic  systems  like  propulsion  plants  is  their  complexity.  A 
major  step  in  the  understanding  of  process  is  the  isolation  of  meaningful  units  to  think  about  and  attend 
to.  Much  of  instruction  and  the  development  of  expertise  is  dependent  on  isolating  such  units  and 
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developing  a  language  that  permits  talking  and  reasoning  about  them.  If  one  looks  at  the  language  an 
expert  uses  in  explaining  or  predicting  a  system’s  behavior,  one  often  sees  a  restatement  of  quantitative 
events  in  qualitative  terms.  The  filtering  of  quantitative  information  into  qualitative  terms  may  be  an 
extremely  effective  means  of  supporting  these  types  of  qualitative  explanations  and  of  providing  infor¬ 
mation  in  forms  that  encourage  development  of  the  mental  models  needed  in  reasoning  about  physical 
systems. 

In  order  to  build  effective  interfaces,  better  tools  are  required.  A  major  portion  of  this  chapter  has 
been  devoted  to  descriptions  of  a  set  of  tools  we  have  built  to  aid  in  the  implementation  of  interactive 
graphical  interfaces.  The  goals  of  our  efforts  have  been  to  simplify  the  implementation  of  interfaces 
and  to  make  it  possible  for  interface  designers  to  operate  at  a  higher  level  of  abstraction  than  that  nor¬ 
mally  provided.  The  object-based  graphics  editor  allows  a  designer  to  operate  at  the  level  of  graphical 
objects  which  have  been  specifically  designed  for  particular  domains.  It  also  provides  the  ability  to 
easily  associate  these  iconic  depictions  with  an  underlying  simulation  or  real-time  system.  The  model 
controller  complements  the  graphics  editor  by  providing  an  integrated  set  of  facilities  for  controlling  the 
running  of  simulation  models  and  interacting  with  views  constructed  with  the  editor.  The  icon  editor 
increases  the  generality  of  this  simulation  environment  by  allowing  users  to  construct  icons  with 
behaviors  that  are  particularly  tailored  to  the  demands  of  new  domains.  It  thus  provides  a  mechanism 
for  extending  the  vocabulary  of  a  graphical  representational  language.  We  have  coupled  these  tools 
with  a  series  of  knowledge-base  editors  to  allow  the  incorporation  of  a  wide  variety  of  knowledge.  The 
behavior  editor  permits  the  specification  of  simulation  knowledge  within  graphical  icons  themselves. 
The  lesson  editor  makes  it  possible  to  build  instructional  interactions  and  to  make  views  capable  of 
explaining  themselves  and  their  constituents.  Designer  brings  graphical  design  knowledge  to  users  of 
the  graphics  editor.  To  further  augment  and  support  the  development  of  this  growing  set  of  tools,  a 
general  frame-based  representational  language  and  graphical  interface  to  it  are  also  available  to  the 
interface  designer. 

All  of  these  software  tools  have  been  implemented  using  the  object-based  programming  techniques  of 
Flavors.  There  are  a  number  of  reasons  that  an  object-oriented  paradigm  is  particularly  advantageous 
for  supporting  the  development  of  graphical  interfaces  to  simulations  and  real-time  systems.  One  pri¬ 
mary  reason  is  the  natural  mapping  possible  between  the  objects  that  a  simulation  models  and  their 
graphical  representation  in  an  interface.  Conceptually  this  makes  possible  a  natural  way  of  dividing  up 
the  simulation  world  as  seen  via  a  graphical  interface.  Also  of  principle  importance  are  the  relation¬ 
ships  that  can  be  made  between  object-based  representations  and  mental  models.  The  fact  that  objects 
store  state  information,  are  made  of  simpler  parts,  and  communicate  with  and  share  information  with 
other  objects  are  obvious  parallels  between  the  two.  These  relationships  facilitate  building  interfaces 
that  have  some  of  the  characteristics  normally  attributed  to  peoples’  mental  models.  In  addition,  they 
provide  a  number  of  programming  features  which  have  proven  to  be  of  considerable  value.  These 
include  nice  modularity,  the  ability  to  inherit  instance  variables  and  messages  and  thus  to  easily  share 
common  structure  and  functionality,  and  ready  extensibility  by  the  addition  of  new  messages. 
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